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Examiner 

George Eng 



Applicant(s) 

STRUBBE ET AL 



Art Unit 

2643 



-- The MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )M Responsive to communication(s) filed on 23 April 2003 . 
2a)D This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) ^ Claim(s) 1-5.7-16 and 18-23 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-5J-16and 18-23 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

£))□ The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) E] The proposed drawing correction filed on 23 April 2003 is: a)^ approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)D All b)D Some*c)n None of: 

1 .□ Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. . 

3-D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attachment(s) 

1 ) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-1 52) 

3) □ Information Disclosure Statement(s) (PTO-1 449) Paper No(s) . 6) □ Other: 

U.S. Patent and Trademark Office " ~~ ~ 

PTO-326 (Rev. 04-01 ) Office Action Summary Part of Paper No. 1 0 
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DETAILED ACTION 



Response to Amendment 

1 . This Office action is in response to amendment filed 4/23/2003 (paper no. 9). 

Drawings 

2. The corrected or substitute drawings were received on 4/23/2003 (paper no. 7). These 
drawings are acceptable. 



3. The following is a quotation of the second paragraph of 35 U.S. C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

4. Claims 1-5, 7-16 and 18-23 are rejected under 35 U.S.C. 1 12, second paragraph, as being 
indefinite for failing to particularly* point out and distinctly claim the subject matter which 
applicant regards as the invention. 

Regarding claims 1,12 and 23, it is unclear how to apply a set of rule to determine which 
of at least one of the audio locator output and the video locator output will be utilized to adjust a 
setting of camera because each claim fails to particular point out in what condition should utilize 
the audio locator output to adjust the camera setting. In addition, the claimed limitation of 
"adjusting the camera setting in accordance with the determined manner of utilization" is vague 
and indefinite because it is unclear what is the determined manner. It appears that the camera 
setting is adjusted in accordance with the set of rules according to the specification 



Claim Rejections - 35 USC § 112 
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Claims 2-5, 7-11, and 13-16 and 18-22 are also rejected because of depending on either 
claim 1 or claim 12 containing the same deficiency. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 1-4, 7-15 and 18-23 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hildin (US PAT. 5,844,599) in view of Bianchi (US PAT. 5,434,617). 

Regarding claim 1, Hildin discloses a method for tracking an object of interest, i.e., an 
active speaker, in a video processing system comprising the steps of generating for a given 
measurement interval an audio locator output and a video locator output, each indicative of a 
location of the object of interest (col. 4 lines 26-50), applying a set of rules to determine at a 
manner in which the audio locator output will be utilized to adjust a setting of the camera based 
in the given measurement interval (col. 4 line 51 through col. 5 line 19), and adjusting the 
camera setting in accordance with the determined manner of utilization (col. 5 lines 55-65). 
Although Hildin does not specifically teach to utilize video locator output to adjust the camera 
setting only if the video locator output confidence indicator is above the video locator threshold 
for the given measurement, Bianchi teaches an automatic tracking camera control method for 
adjusting a camera setting when a video locator confidence indicating means is above a 
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predetermined threshold for a given measurement interval (figure 8 and col. 9 line 26 through 
col. 12 line 54) in order to effectively track movements of an object automatically. Therefore, it 
would have been obvious to a person of ordinary skill in the art at the time the invention was 
made to modify Hildin in utilizing video locator output to adjust the camera setting only if the 
video locator output confidence indicator is above the video locator threshold for the given 
measurement, as per teaching of Bianchi, because it makes effectively to automatically track 
movement of an object. 

Regarding claim 2, Hildin discloses the object of interest comprising an active speaker, 
i.e., a moving person (col. 2 lines 29-30). 

Regarding claim 3, Hildin discloses the camera is a pan-tilt-zoom camera having 
adjustable pan, tilt, and zoom settings (col. 2 lines 30-38 and col. 5 lines 60-65). 

Regarding claim 7, Hildin teaches to determine based nn the audio locator output if the 
object of interest corresponds to a new speaker in a multiple-participant system and directing the 
camera to zoom out by a predetermined amount and to turn in a direction of the new speaker if a 
new speaker is detected (col. 5 lines 4-19 and col. 6 lines 2-9). 

Regarding claim 8, Hildin discloses to determine whether the object of interest 
corresponds to a same speaker in a multiple-participant system based on the audio locator output 
(col. 4 lines 43-64), and utilizing the video locator output to adjust camera setting so as place the 
same speaker at a designated position within one or more video frames generated by the camera 
(col. 4 lines 26-42). 

Regarding claim 9, Hildin teaches to locate a head of the identified same speaker 
occupied a designated portion of a given one or more video frame generated by the camera by 
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for precision adjustments of the field of view (col. 6 lines 10-14) such that it includes adjusting a 
zoom setting of the camera. 

Regarding claim 10, Hildin teaches to zoom out the camera by a predetermined amount 
after a detect period of continued silence exceeds a first amount of time (col. 6 lines 6-9). 

Regarding claim 12, Hildin discloses an apparatus for tracking an object of interest, i.e., 
an active speaker, in a video processing system as shown in figure 5 comprising a camera (102) 
and a processor (106) coupled to the camera and operative to process an audio locator output and 
a video locator output, each indicative of a location of the object of interest for a given 
measurement interval (col. 4 lines 26-50), to apply a set of rules to determine at a manner in 
which the audio locator output will be utilized to adjust a setting of the camera based in the given 
measurement interval (col. 4 line 51 through col. 5 line 19) so that the camera setting is adjusted 
in accordance with the determined manner of utilization (col. 5 lines 55-65). Although Hildin 
does not specifically teach to utilize video locator output to adjust the camera setting only if the 
video locator output confidence indicator is above the video locator threshold for the given 
measurement, Bianchi teaches an automatic tracking camera control method for adjusting a 
camera setting when a video locator confidence indicating means is above a predetermined 
threshold for a given measurement interval (figure 8 and col. 9 line 26 through col. 12 line 54) in 
order to effectively track movements of an object automatically. Therefore, it would have been 
obvious to a person of ordinary skill in the art at the time the invention was made to modify 
Hildin in utilizing video locator output to adjust the camera setting only if the video locator 
output confidence indicator is above the video locator threshold for the given measurement, as 
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per teaching of Bianchi, because it makes effectively to automatically track movement of an 
object. 

Regarding claim 13, the limitations of the claim are rejected as the same reasons set forth 
in claim 2. 

Regarding claim 14, the limitations of the claim are rejected as the same reasons set forth 
in claim 3. 

Regarding claims 18-21, the limitations of the claims are rejected as the same reasons set 
forth in claims 7-10, respectively. 

Regarding claim 23, the limitations of the claim are rejected as the same reasons set forth 
in claim 1. 

7. Claims 4 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable over Hildin 
(US PAT. 5,844,599) in view of Bianchi (US PAT. 5,434,617) as applied in claims above, and 
further in view of Pingali (US PAT. 6,005,610). 

Regarding claims 4 and 15, the combination of Hildin and Bianchi differs from the 
claimed invention in not specifically teaching to determine if the audio locator and video locator 
output are sufficiently close for the give measurement interval, and utilize the audio locator 
output to adjust the camera setting if the audio and video locator outputs are not within a 
specified range of one another for the given measurement interval. However, Pingali teaches an 
integrated localizer to determine whether a visual object localizer and audio source localizer are 
sufficiently close for a given measurement interval (col.8 line 65 through col. 9 line 5) and to 
utilize the audio source localizer output to adjust a camera when the visual object localizer 
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output and the audio source localizer outputs are not within a specified range in order to improve 
estimate of the location of an identified object (col. 9 lines 6-25 and lines 31-53). Therefore, it 
would have been obvious to a person of ordinary skill in the art at the time the invention was 
made to modify the combination of Hildin and Bainchi in determining if the audio locator and 
video locator output are sufficiently close for the give measurement interval, and utilize the 
audio locator output to adjust the camera setting if the audio and video locator outputs are not 
within a specified range of one another for the given measurement interval, as per teaching of 
Pingali, because it improves estimate of the location of an identified object. 



8. Claim 5 and 16 would be allowable if rewritten to overcome the rejection(s) under 35 
U.S.C. 1 12, second paragraph, set forth in this Office action and to include all of the limitations 
of the base claim and any intervening claims. 

Conclusion 

9. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington D.C. 20231 
Or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 
Hand delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
Arlington, V.A., Sixth Floor (Receptionist). 



Allowable Subject Matter 
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10. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to George Eng whose telephone number is 703-308-9555. The 
examiner can normally be reached on Tuesday to Friday from 7:30 AM to 6:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Curtis A. Kuntz, can be reached on (703) 305-4870. The fax phone number for the 
organization where this application or proceeding is assigned is 703-308-6306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 306-0377. 



George Eng 




Examiner 



Art Unit 2643 



